Utilizing Domain Knowledge in Neuroevolution
نویسندگان
چکیده
We propose a method called Rule-based ESP (RESP) for utilizing prior knowledge evolving Artificial Neural Networks (ANNs). First, KBANN-like techniques are used to transform a set of rules into an ANN, then the ANN is trained using the Enforced Subpopulations (ESP) neuroevolution method. Empirical results in the Prey Capture domain show that RESP can reach higher level of performance than ESP. The results also suggest that incremental learning is not necessary with RESP, and it is often easier to design a set of rules than an incremental evolution scheme. In addition, an experiment with some of the rules deleted suggests that RESP is robust even with an incomplete knowledge base. I~ESP therefore provides a robust methodology for scaling up neuroevolution to harder tasks by utilizing existing knowledge about the domain.
منابع مشابه
Comparison of NEAT and HyperNEAT on a Strategic Decision-Making Problem
Neuroevolution is a useful machine learning approach for problems with limited domain knowledge, but it has not done well with strategic decision-making problems, where the correct action varies sharply as the agent moves across states. Two promising neuroevolution algorithms are NeuroEvolution of Augmenting Topologies (NEAT) and its extension, HyperNEAT. We compare the performance of these two...
متن کاملCross-Domain Knowledge Transfer Using Structured Representations
Previous work in knowledge transfer in machine learning has been restricted to tasks in a single domain. However, evidence from psychology and neuroscience suggests that humans are capable of transferring knowledge across domains. We present here a novel learning method, based on neuroevolution, for transferring knowledge across domains. We use many-layered, sparsely-connected neural networks i...
متن کاملAn Interactively Constrained Neuro-Evolution Approach for Behavior Control of Complex Robots
Behavior control of complex technical systems, such as robots, is still a challenging problem. In this context, embodied neuro-control is a bioinspired method to handle these problems, and evolutionary robotics takes up some essential research topics in this field. But for systems with many multimodal sensor inputs and actuating outputs new evolutionary methods have to be applied because the se...
متن کاملNumerical Optimization with Neuroevolution
Neuroevolution techniques have been successful in many sequential decision tasks such as robot control and game playing. This paper aims at establishing whether they can be useful in numerical optimization more generally, by comparing neuroevolution to linear programming in a manufacturing optimization domain. It turns out that neuroevolution can learn to compensate for uncertainty in the data ...
متن کاملIncorporating Advice into Evolution of Neural Networks
Neuroevolution is a promising learning method in tasks with extremely large state and action spaces and hidden states. Recent advances allow neuroevolution to take place in real time, making it possible to e.g. construct video games with adaptive agents. Often some of the desired behaviors for such agents are known, and it would make sense to prescribe them, rather than requiring evolution to d...
متن کامل